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1.  Summary 

We  have  made  significant  progress  on  all  three  topics  described  in  the  proposal  during  the  grant 
period.  A  large  amount  of  effort  has  gone  into  the  developmem  of  large  scale  global  optimization 
methods  for  molecular  configuration  problems.  We  have  developed  new  general  purpose  methods  that 
combine  efficient  stochastic  global  optimization  techniques  with  several  itew,  more  deterministic  tech¬ 
niques  that  account  for  most  of  the  computational  effort,  and  the  success,  of  the  methods.  We  have 
s^plied  our  methods  to  Leonard- Jones  problems  with  up  to  7S  atoms,  to  water  clusters  with  up  to  32 
molecules,  and  to  polymer  stmctures  of  up  to  58  amino  acids.  The  results  r^pear  to  be  the  best  so  far  by 
general  purpose  optimization  methods,  and  appear  to  be  leading  to  some  interesting  chemistry  issues. 
Our  research  on  die  second  topic,  tensor  methods,  has  addressed  several  areas.  We  have  designed  and 
implemented  tensor  methods  for  large  sparse  systems  of  nonlinear  equations  and  nonlinear  least  squares, 
and  have  obtained  excellent  test  results  on  a  wide  range  of  problems.  In  conjunction  we  have  developed 
parallel  versions  of  some  of  these  methods  and  shown  that  they  obtain  very  good  speedups.  We  have  also 
developed  new  tensor  methods  for  nonlinearly  constrained  optimization  problem,  and  have  obtained 
promising  theoretical  and  preliminary  computational  results  for  these  methods.  Finally,  on  the  third 
topic,  limited  memory  methods  for  large  scale  optimization,  we  have  developed  and  implemented  new, 
extremely  efficient  limited  memory  methods  for  bound  constrained  optimization  problems,  and  new  lim¬ 
ited  memory  trust  region  methods,  both  using  our  recently  developed  compact  representations  for  quasi- 
Newton  matrices.  We  have  a  well-tested  code  for  bound  constrained  optimization  which  we  plan  to  make 
publicly  available  in  the  immediate  future. 

In  the  following  three  sections  we  describe  our  research  on  these  topics,  and  also  briefly  discuss  our 
continuing  research  plans  in  these  areas. 
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2.  Large  Scale  Global  Optimization  Methods  for  Molecular  Configuration  Problems 


We  have  been  developing  global  optimization  methods  for  finding  the  lowest  energy  configurations 
of  molecular  structures.  To  do  this,  one  must  find  the  lowest  (global)  minimum  of  energy  functions  tiiat 
generally  have  very  many  parameters  and  huge  numbers  of  local  minimizers.  Therefore,  these  are  very 
difficult  global  optimization  problems.  Our  approach  is  to  develop  fairly  general  purpose  methods  that  do 
not  utilize  any.  knowledge  of  the  solution  structure,  and  are  applicable  to  a  broad  class  of  partially  separ¬ 
able  large  scale  global  optimization  problems.  The  methods  combine  efficient  stochastic  global  optimiza¬ 
tion  techniques  with  several  new.  more  deterministic  perturbation  techniques.  So  far  we  have  applied  our 
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methods  to  Lennard- Jones  problems  with  up  to  7S  atoms,  to  water  clusters  with  up  to  32  molecules  whose 
energy  is  given  by  the  Coker/Watts  potential,  and  to  polymers  with  up  to  59  amino  acids  with  potential 
energy  given  by  the  CHARMM  package.  The  results  appear  to  be  the  best  so  far  by  general  purpose 
optimization  methods,  and  appear  to  be  producing  some  interesting  chemistry  issues. 

Our  methods  combine  an  initial  phase  that  locates  some  initial  low  local  minimizers  and  is  derived 
from  previous  stochastic  methods,  and  a  second,  more  deterministic  phase  for  progressing  from  low  to 
even  lower  local  minimizers  that  is  new  and  accounts  for  most  of  the  computational  effort,  and  the  suc¬ 
cess,  of  the  methods.  Both  phases  make  critical  use  of  new  portions  that  vary  only  a  small  subset  of  vari¬ 
ables  (an  atom  for  Lennard-Jones,  a  molecule  for  water,  or  a  small  set  of  torsion  angles  for  polymers)  at 
once.  In  the  initial  frirase  this  is  used  to  improve  the  sample  points,  in  the  second  j^iase,  to  move  one 
atom  or  molecule  in  an  existing  configuraticm  to  better  positions  via  dte  one  atomAnolecule  global  optim¬ 
izations.  These  steps  are  relatively  inexpensive  due  to  the  small  nurnber  of  variables  involved  and  the 
separability  of  the  energy  function.  An  expansion  of  the  cluster  before  the  one  molecule  global  optimiza¬ 
tion  was  added  for  the  water  problem,  and  is  crucial  to  the  success  of  the  method  because  it  permits  the 
method  to  move  to  significantly  different  structures.  Heuristics  for  deciding  which  configuration  and 
molecule  to  improve  next  have  also  been  important  to  the  success  of  the  water  method.  These  methods 
could  be  api^ed  to  any  partially  separable  function,  although  the  determmation  of  the  unit  to  vary  at  tmce 
would  be  problem  dependent.  They  could  also  be  applied  to  ab  initio  energy  functions,  but  new  methods 
would  be  required  to  retain  the  relative  efficiency  of  the  one  atom/rnolecule  moves. 

We  have  run  a  simplified  version  of  our  algorithm,  with  no  e:q>ansion  i^iase,  on  Lennard-Jones 
problems  with  up  to  55  atoms.  For  up  to  30  atoms  we  find  the  best  known  solutions.  iiu:luding  a  solution 
for  22  atoms  that  was  unknown  prior  to  Northby’s  special  purpose  Lennard-Jones  method.  For  over  30 
atoms  we  usually  do  not  find  quite  as  good  a  solution  as  the  Northby  method,  although  in  preliminary 
tests  on  problems  with  30-40  atoms,  adding  the  expansion  phase  enables  us  to  find  Northby ’s  solutions. 
Our  solutions  are  apparently  by  the  far  the  best  that  have  been  produced  for  tiiese  problems  by  a  general 
purpose  global  optimization  method. 

For  water,  we  have  mainly  run  our  algorithm  on  clusters  of  20  and  21  water  molecules,  because 
results  of  minimizing  these  same  clusters  and  energy  function,  using  a  dynamic  simulated  annealing  pro¬ 
cedure,  have  been  obtained  by  X.  Long  at  University  of  California,  San  Diego.  We  have  obtained  many 
configurations  with  significantly  lower  energies  than  Long’s.  At  present,  the  best  solutions  obtained  by 
tunning  our  algorithm  ffom  scratch  have  energies  of  -0.3447  and  -0.3608  atomic  units  (a.u.)  for  20  and  21 
molecules.  These  are  approximately  0.002  and  0.004  a.u.  lower  than  the  best  structures  found  by  Long, 
respectively,  whereas  at  room  temperature,  only  vibrational  states  with  energies  about  0.001  a.u.  above 
the  ground  state  are  likely.  By  using  Long’s  best  20  water  molecule  solution  as  a  starting  point  of  the 
second  phase  of  our  algorithm,  however,  we  located  three  even  better  20  molecule  structures,  with  the 
lowest  having  energy  -0.3477  a.u..  By  using  these  three  20  molecule  structures,  augmented  by  a  ran¬ 
domly  sampled  21st  molecule,  as  a  starting  point  for  the  second  phase  of  the  21  molecule  problem,  we 
obtained  mwy  significantly  better  21  molecule  solutions,  with  the  lowest  having  energy  -0.3679  a.u.. 
The  computational  effort  expended  by  our  algorithm  is  considerably  less  than  Long’s.  We  still  do  ru)t 
know,  however,  whether  the  structures  we  have  found  are  global  minima.  Of  the  current  best  structures, 
some  have  the  expected  dodecahedral  (for  21)  or  colltqrsed  dodecahedral  (for  20)  shapes,  but  some  tiiat 
are  very  close  to  the  current  minimum  have  far  mote  irregular  shapes.  If  these  are  indeed  possible  vibra¬ 
tional  states,  this  raises  interesting  questions  about  either  the  possible  structure  of  water  cluster  or  the 
validity  of  the  Coker/Watts  energy  function. 
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This  work  has  been  presented  at  the  SIAM  Conference  on  Optimization  and  at  workshops  at  the 
University  of  California,  San  Diego  and  at  Iowa  Sme  University.  A  p^r  on  the  initial  algorithm  and  its 
application  to  Lennard-Jones  (mblems  has  been  completed  and  submitted  for  publication,  and  several 
other  papers  are  in  preparation.  We  are  actively  continuing  this  work,  including  the  porting  of  this  code 
(which  is  already  parallel)  to  Intel  distributed  memory  multiprocessors  so  that  we  can  make  longer  runs 
and  run  on  harder  problems,  and  continued  testing  and  algorithm  development  in  the  context  of  the  water 
problem. 

We  have  also  begin  working  on  configuration  problems  associated  with  polymers.  The  polymer 
problem  we  have  begim  working  with  is  the  protein  polyalanine,  using  the  CHARMM  energy  function  to 
compute  the  potential  energy.  As  is  common  in  this  area  we  have  been  treating  tiie  bond  lengths  and 
bond  angles  as  fixed,  and  have  been  trying  to  find  the  optimal  values  of  the  dihedral  angles.  This  parame¬ 
terization  is  natural  because  the  dihedral  angles  are  the  crucial  parameters  to  be  varied  in  the  optimiza¬ 
tion,  and  more  efficient  because  the  number  of  variables  is  greatly  reduced,  but  the  internal  parameteriza¬ 
tion  leads  to  some  interesting  algorithmic  challenges.  We  have  ad^ted  our  general  approadt  to  this 
framework  in  two  ways.  In  the  initial  phase,  the  sampling  is  done  by  generating  dihedral  angles  sequen¬ 
tially  along  the  chain,  and  the  angle  is  resampled  if  it  gives  a  poor  value  for  the  potential  up  to  that  point 
In  the  second  phase  we  try  to  improve  local  minimizers  by  selecting  a  small  subset  of  dihedral  angles,  and 
doing  global  minimization  on  a  the  resulting  small  dimensional  problem,  followed  by  full  dimensional 
local  minimization  as  above.  So  far  we  have  been  able  to  find  what  appears  to  be  the  global  solution  for 
problems  with  10  and  20  amino  acids  (20  and  40  dihedral  angles).  We  have  just  begun  working  on  a 
problem  with  58  amino  acids.  The  results  here  are  incomplete  but  we  are  using  them  to  tune  the  algo¬ 
rithm. 


3.  Tensor  Methods  for  Large  Sparse  Nonlinear  Problems  and  for  Constrained  Optimization 

Over  the  last  decade  we  have  developed  a  new  class  of  methods,  called  tensor  methods,  for  solving 
nonlinear  equations  and  unconstrained  optimization  problems.  These  methods  {q)pear  to  be  considerably 
more  efficient  and  robust  than  the  best  standard  algorithms  based  upon  Newton’s  method.  During  this 
research  period,  we  have  continued  this  work  in  several  directions.  Brst,  we  have  completed  the  develop¬ 
ment  and  implementation  of  an  efficient  software  package  for  tensor  methods,  as  well  as  standard  Newton 
or  Gauss-Newton  methods,  for  solving  large  sparse  systems  of  nonlinear  equations  and  nonlinear  least 
squares  problems.  These  methods  use  efficient,  state  of  the  art  sparse  linear  algebra  techniques.  We  con¬ 
ducted  substantial  tests  of  this  software,  that  show  that  the  tensor  methods  have  large  advantages  in 
robustness  and  computatiotud  cost  over  standard  methods.  This  research  is  contained  in  the  Ph.D.  thesis 
of  Ali  Bouaricha  and  in  upcoming  papers,  and  has  been  discussed  in  several  talks  including  our  plenary 
talk  on  tensor  methods  at  the  July  1992  SIAM  National  Meeting. 

Secondly,  we  developed  parallel  versions  of  tensor  methods  for  small  to  medium  size  problems, 
and  began  the  development  of  Krylov-subspace  based  tensor  methods  for  very  large  problems  that  are 
amenable  to  efficient  parallelization.  The  tests  of  the  parallel  tensor  methods  on  an  Intel  hypercube 
showed  that  there  is  no  loss  in  parallel  efficiency  between  tensor  methods  and  standard,  linear  model 
based  methods.  This  means  fiiat  tensor  methods  have  the  same  advantages  in  computational  costs  on 
parallel  as  on  s^ential  computers.  The  preliminary  results  of  the  Krylov  sub^ce  methods  showed  ten¬ 
sor  mefiK)ds  can  still  lead  to  substantial  advantages  in  computational  cost  over  aruilogous  Krylov 
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sub^ace  based  linear  model  methods,  even  though  there  is  an  extra  system  that  needs  to  be  solved  at 
each  iteration.  A  paper  on  this  work  has  been  accepted  for  publication  at  the  upcoming  SIAM  Confer¬ 
ence  of  Parallel  Processing  for  Scientific  Computation. 

Fmally,  we  have  continued  to  develop  tensor  methods  for  nonlinearly  constrained  optimization 
problems.  Our  new  methods  augment  the  standard  linear  model  of  the  constraints  by  a  tensor  tenn. 
These  methods  are  intended  to  be  especially  helpful  on  problems  where  the  active  constraints  are  (nearly) 
rank  deficient  at  the  solution,  an  important  class  of  problems  that  are  not  solved  efficiently  by  current 
methods.  We  developed  two  types  of  tensor  models  for  nonlinear  constrained  problems,  and  a  full  global 
algorithm  based  upon  these  models.  We  have  analyzed  a  simple  method  horn  this  class  and  shown  that  it 
has  fast  convergence  on  problems  where  the  constraint  Jacobian  at  the  solution  has  a  null  space  of  dimen¬ 
sion  one,  whereas  standard  methods  are  only  linearly  convergent  on  such  problems.  We  have  made  com¬ 
putational  tests  of  one  of  the  new  methods,  and  they  appear  to  be  exhibiting  substantial  gains  in  efficiency 
over  standard  mediods.  In  doing  this  we  have  developed  a  generalization  of  the  standard  Kuhn-Tucker 
conditions  for  constrained  optimization  in  the  case  of  rank  deficiency.  This  gerreralizadon  is  both 
mathematically  interesting  and  relevant  to  computational  optimizadoti  methods.  This  work  has  formed  a 
major  part  of  Dan  Feng’s  Ph.D.  thesis,  and  both  tire  theoretical  and  computational  portions  of  the  work 
are  continuing. 


4.  Limited  Menrery  Methods  for  Large  Scale  Optimization 

Our  research  on  limited  memory  quasi-Newton  meffiods  has  continued  and  moved  in  some  new 
directions.  Limited  memory  methods  work  by  generating  a  quasi-Newton  rqjproximadon  to  the  Hessian 
of  the  objective  function  that  uses  only  the  most  recent  updates,  resulting  in  great  savings  in  storage, 
independent  of  sparsity  of  the  Hessian.  Thus  they  are  an  important  approach  to  very  large  optimization 
problems  where  the  number  of  variables  is  too  large  to  allow  a  full  Hessian  approximation  to  be  stored. 

Our  work  on  a  new  compact,  closed  form  representation  of  limited  memory  quasi-Newton  matrices 
has  been  essentially  completed.  A  paper  describing  this  work  by  the  principal  investigators  together  with 
Jorge  Nocedal  of  Northwestern  University  was  completed  during  this  research  period  has  been  accepted 
for  publication  by  Mathematical  Programming.  This  representation  is  a  important  part  of  our  extensions 
of  the  limited  memory  tqjproach  to  constrairred  optimization  and  to  trust  region  methods  discussed  below, 
and  several  researchers  have  shown  interest  is  using  it  also. 

For  optimization  problems  with  bound  constraints,  we  have  developed  an  algorithm  using  this  rrew 
approach,  that  is  extremely  efficient  in  linear  algebra  cost  In  numerical  experiments  our  method  is  com¬ 
petitive  with  the  partially  separable  update  method  of  Conn,  Gould  and  Toint,  but  it  is  applicable  to  a 
broader  class  of  problems,  and  in  some  cases  it  is  easier  to  implement  for  a  particular  application.  We 
have  written  a  paper  based  on  this  work  with  Jorge  Nocedal.  In  addition  we  have  developed  and  tested 
software  using  this  method  to  solve  bound  constrained  optimization  problems,  which  we  plan  to  make 
publicly  available,  and  which  we  will  describe  in  a  separate  paper. 

We  have  also  developed,  together  with  doctoral  student  Xuehua  Lu.  an  efficient  implementation  of 
a  limited  memory  symmetric  rank  one  method,  using  a  trust  region  tqiproach.  The  trust  region  allows  us 
to  model  iregative  curvature,  and  the  compact  representation  allows  the  trust  region  computations 
efficiently.  Preliminary  tests  for  this  approach  look  promising.  A  talk  on  this  work  was  given  at  the 
TIMS/ORSA  Joint  National  Meeting  in  Chicago,  May  1993. 
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global  optimization  algorithm.  University  of  Colorado  Technical  Report  CU-CS-625-92,  submitted 
to  IEEE  Parallel  and  Distributed  Systems. 

(9)  R.  H.  Byrd,  E.  Eskow,  and  R.  B.  Schnabel,  "A  new  large-scale  global  optimization  method  and  its 
application  to  Lennard- Jones  problems".  University  of  Colorado  Technical  Report  CU-CS-630-92, 
submitted  SIAM  Journal  on  Optimization. 

(10)  Khalfan,  H  J^.,  Byrd,  R.H.,  and  Schnabel,  R.B.,  "A  Theoretical  and  Experimental  Study  of  the  Sym¬ 
metric  Rank-One  Update",  SIAM  Journal  on  Optimization  3, 1993,  pp  1-24. 

(1 1)  R.H.  Byrd,  E.  Eskow,  R.  Schnabel  and  S.  Smith,  "Parallel  global  optimization:  numerical  methods, 
dynamic  scheduling  methods,  and  replication  to  molecular  configuration",  in  Parallel  Computa¬ 
tion,  A.E.  Fincham  and  B.  Ford,  eds.,  Garendon  Press,  Oxford,  1993 

(12)  R.  H.  Byrd,  P.  Lu,  J.  Nocedal  and  C.  Zhou,  "A  limited  memory  algorithm  for  bound  constrained 
optimization".  Technical  Report  NAM-07,  Dept  of  Electrical  Engineering  and  Computer  Science, 
Northwestern  University,  1^3,  submitted  to  SIAM  Journal  on  Optimization. 

(13)  R.H.  Byrd,  T.  Derby,  E.  Eskow,  K.  P.  B.  Oldenkamp,  and  R.  B.  Schnabel,  "A  new 
stochastic^rturbation  method  for  large-scale  global  optimization  and  its  ap{dication  to  water  dus¬ 
ter  problems",  in  Large  Scale  Optimization:  State  of  the  Art,  W.W.  Hager,  D.W.  Hearn,  and  P.M. 
Pardos  eds.,  Kluwer  Academic  Publishers,  Dordrecht,  1994. 

(14)  A.  Bouaricha  and  R.B.  Schnabel,  "Parallel  tensor  methods  for  nonlinear  equations  and  nonlinear 
least  squares",  in  Proceedings  of  Sixth  SIAM  Coitference  cf  Parallel  Processing  for  Scientific 
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Computation,  SIAM,  Philadelphia.  1993,  pp.  639-643. 

(15)  R.H.  Byrd,  T.  Derby,  E.  Eskow,  K.  Oldenkamp,  R.B.  Schirabel  and  C.  TriantafiUou,  "Parallel  glo¬ 
bal  optimization  methods  for  molecular  configuration  problems”,  in  Proceedings  of  Sixth  SIAM 
Corference  cf  Parallel  Processing  for  Scientific  Computation,  SIAM,  Philadelphia,  1993,  pp.  165- 
169. 
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6.  Professional  Personnel  Supported  by  Grant  during  this  Period 


R.  Byrd,  Co-Principal  Investigator 
R.  Schnabel,  Principal  Investigator 


Ali  Bouaricha,  Research  Assistant,  12/91  -  8/92 

Mr.  Bouaricha  completed  his  Ph.D  in  Computer  Science  in  August  1992.  His  research  was  on  tensor 
methods  and  software  for  large  sparse  problems,  and  is  described  in  Section  3. 


Dan  Feng,  Research  Assistant,  12/91  -  7/92 

Mr.  Feng  was  a  Ph.D  student  in  the  Department  of  Computer  Science  at  the  University  of  Colorado 
at  Boulder.  He  did  his  doctoral  dissertation  on  the  analysis  of  tensor  methods  and  their  extension  to 
constrained  optimization  described  in  Section  3.  He  completed  his  Ph.D.  in  summer  1993.  (Since 
August  1992  he  has  been  supported  by  a  differeru  grant) 


Bart  Oldenkamp,  Research  Assistant  8^  -  3^3 

Mr.  Oldenkamp  is  a  visiting  graduate  student  from  Erasmus  University  in  Rotterdam,  HollarKl.  He 
is  working  on  the  development  implementation,  and  testing  of  the  global  optimization  algorithms 
for  molecular  configuration  problems  described  in  Section  2.  He  will  do  his  M.S.  thesis  partially 
under  our  supervision  and  then  return  to  Erasmus  University  for  his  Ph.D. 


Christos  Triantafillou,  Research  Assistant  9/92  - 1^2 

Mr.  Triantafillou  is  a  Hi.D  student  in  the  Department  of  Computer  Science  at  the  University  of 
Colorado  at  Boulder.  He  worked  in  fall  1992  on  the  development  of  parallel  methods  for  the  molec¬ 
ular  configuration  problems  described  in  Section  2. 


Andre  van  der  Hoek,  Research  Assistant  8/93  - 1 1/93 

Mr.  van  der  Hoek  is  a  visiting  graduate  student  from  Erasmus  University  in  Rotterdam,  Holland.  He 
is  working  on  the  development  implementation,  and  testing  of  the  global  optimization  algorithms 
for  the  protein  configuration  problems  described  in  Section  2.  He  will  do  his  M.S.  thesis  partially 
urxler  our  supervision. 


Chung-Shang  Shao,  Research  Assistant  9/93  - 11/93 

Mr.  Shao  is  a  Ph.D  student  in  the  Department  of  Computer  Science  at  the  University  of  Cblorado  at 
Boulder.  He  worked  in  Fall  1992  on  experiments  on  parallel  implementations  of  quasi-Newton 
methods,  with  emphasis  on  molecular  configuration  computations. 
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7.  Presentations  about  Grant  Research  at  Technical  Meetings  during  this  Period 

(1)  R.  H.  Byrd,  "The  symmetric  rank-one  method  in  a  trust  region  context”,  invited  talk.  Sixth  IIMAS 
Workshop  on  Numerical  Analysis  and  Optimization,  Oaxaca,  Mexico,  January  1992. 

(2)  R.  H.  Byrd,  "Constrained  optimization  algorithths  using  limited  memory  methods",  invited  min¬ 
isymposium  talk.  Fourth  SIAM  Conference  on  Optimization,  Chicago,  May  1992. 

(3)  R.H.  Byrd  "Secant  methods  for  large  scale  constrained  optimization",  invited  talk,  TIMS/ORSA 
Joint  National  Meeting,  Chicago,  May  1993. 

(4)  R.  B.  Schnabel,  "Global  optimization  methods  for  molecular  configuration  problems",  invited  min¬ 
isymposium  talk.  Fourth  SIAM  Conference  on  Optimization,  Chicago,  May  1992. 

(5)  R.  B.  Schnabel,  "Tensor  methods  for  nonlinear  equations  and  optimization",  invited  plenary  talk, 
SIAM  Annual  Meeting,  Los  Angeles,  July  1992. 

(6)  R.  B.  Schnabel,  "Global  optimization  methods  for  molecular  configuration  problems",  invited  talk. 
Joint  UCSD-SDSC  Woricshop  on  Computational  Aspects  of  Material  Science,  San  Diego,  Sep¬ 
tember  1992. 

(7)  R.  B.  Schnabel,  Tensor  methods  for  nonlinear  equations  and  optimization",  invited  talk.  Workshop 
on  New  Optimization  Techniques  for  Large  Compounds,  Ames,  Iowa,  JatL  1993. 

(8)  R.  B.  Schnabel  "Parallel  optimization:  the  good,  the  bad,  and  the  ugly",  invited  talk,  DIMACS 
Workshop  on  Future  Directions  for  Parallel  Optimization,  New  Brunswick,  NJ,  Apr.  1993. 

(9)  R  B.  Schnabel.  "Parallel  nonlinear  optimization*,  invited  talk  NATO  Advanced  Study  Institute  on 
Optimization,  n  Ciocco,  Italy,  Sept  1993. 

(10)  R.  B.  Schnabel,  "Parallel  and  global  optimization”,  invited  talk,  ORSA-TIMS  National  Meeting. 
Phoenix,  AZ,  Nov.  1993. 


